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The principal eigenvalue A of a network's adjacency matrix often determines dynamics on the network (e.g., in 
synchronization and spreading processes) and some of its structural properties (e.g., robustness against failure or 
attack) and is therefore a good indicator for how "strongly" a network is connected. We study how A is modified 
by the addition of a module, or community, which has broad applications, ranging from those involving a single 
modification (e.g., introduction of a drug into a biological process) to those involving repeated additions (e.g., 
power-grid and transit development). We describe how to optimally connect the module to the network to either 
maximize or minimize the shift in A, noting several applications of directing dynamics on networks. 



I. INTRODUCTION 

Spectral approaches to the analysis of complex networks 
are becoming increasingly important due to their ability to 
describe the effect of network structure on dynamical pro- 
cesses. In particular, the principal eigenvalue A of a network's 
weighted adjacency matrix A (A^ is nonzero if there exists a 
link from node i to node j) is significant for dynamics on net- 
works such as the synchronization of heterogeneous oscilla- 
tors [1 , 2J, epidemic and information spreading |3 |, structural 
robustness (percolation) |4], the stability of equilibria for cer- 
tain systems of network-coupled ordinary differential equa- 
tions 1 5 1, the stability of gene expression in genetic networks 
|l6J, and criticality in network-coupled excitable systems |7|. 

Given the importance of A in determining the outcome of so 
many dynamical processes on networks, there has been much 
interest in modifying A through structural perturbations. In 
particular, the effect of removing node j can be quantified by 
its dynamical importance: Ij = —SX/X ~ VjUj/v^u ISj, 
where u (v) is the right (left) eigenvector corresponding to the 
principal eigenvalue A (i.e., Au = Xu, A = Xv^), and 5X 
is the decrease in the principal eigenvalue that would result 
from the removal of node j. As an example application, a 
node removal strategy targeting nodes with large dynamical 
importance fragments a network more rapidly than targeting 
nodes with large degree (number of links) (HI . Reference ||9| 
extended these results by finding perturbative expressions for 
the change in eigenvalue 5X due to the removal of groups of 
nodes as well as the addition or deletion of groups of links. 
Reference 1 10| considered a perturbative approach to studying 
the spectrum of networks with community structure. 

In this study, we consider the effect on the largest eigen- 
value of a network's adjacency matrix from the addition of a 
secondary network (referred to as the module or community). 
As opposed to previous work lIS HTOl , we explicitly consider 
the effect of the module's topology on the resulting eigenvalue 
and use this information to discuss how one can make optimal 
connections to either maximize or minimize the effect on A. 
There are many applications where smaller groups adhere to 
a larger network in social and economical networks ifTTl (e.g.. 



the merging of corporations or markets) and biological net- 
works (e.g., modifying a system of biochemical reactions with 
a drug fT2l [131 or the merging of ecosystems lfT4l ). For ex- 
ample, recent studies have shown that the effect on the largest 
eigenvalue of the Jacobian matrix describing interactions in 
an ecological network due to the addition of a species may 
be integral to the formation of ecological communities |15|. 
Moreover, our results offer new insight regarding the preva- 
lence of subgraph motifs (recurrent subgraphs having a fre- 
quency higher than expected). While motifs have been cited 
as essential building blocks in biological networks lfT6l . their 
role is not fully understood. For example, in contrast to sev- 
eral studies indicating that the global stability and robustness 
of a system is strongly influenced by the structure of motifs 
IITtI . our study suggests that "how" a motif is connected to 
the remaining network may be as significant as its structure 
(see Fig. |5]l. 

This paper is organized as follows. In SecjHjwe describe 



the problem and introduce variables. In Sec. II A we present 
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perturbative approximations for (5 A in terms of spectral prop- 
erties of A and the module to be added. In Sec. IIIBI we test 
these approximations on several real networks. In Sec.[lll|we 
discuss how our results can be used to optimize the connec- 
tions between the original network and module. In Sec. IV 
we discuss our results, citing several applications of how they 
may be used to direct dynamics on networks. These results 
have application in a range of cases from those in which just a 
single merger needs to be optimally designed to cases where 
a large number of small additions need to be optimized to 
quickly evolve A to a desired value. 



n. MODULE ADDITION 

We consider the addition of a secondary network, or mod- 
ule, to an existing network, as shown schematically in Fig.[T] 
The original network of size n is described by an n x n 
weighted adjacency matrix A such that its entries Atj sat- 
isfy Aij 7^ if there exists a link from node i to node j and 
Aij — otherwise. Another network of size m (described by 
an m X m adjacency matrix S) is to be connected to the orig- 
inal network. We will refer to this secondary network as the 
module. In what follows, we will sometimes refer to both the 
original network and the module by their respective adjacency 
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FIG. 1: (Color online) A module (described by matrix S) is con- 
nected to the original network (described by matrix A) using directed 
connections (described by the matrices X and Y). 



matrices, A and S. 

Assuming that the original eigenvalue problems Au = Xu 
and A = have been solved, the modified eigenvalue 
problem after module addition may be formulated as 
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where we use the following definitions: (i) 8\>0 denotes the 
shift in the largest eigenvalue; (ii) matrix X (Y) is size n x m, 
has positive entries, and describes all directed links from A to 
S {S to A); (iii) A'^ is a vector of length n which represents 
the shift in eigenvector u; and (iv) A^ is a vector of length 
m which represents the new eigenvector components. For the 
typical case in which no negative weights are allowed (i.e., 
A-ij > 0), the principal eigenvalues {A, A + SX} and all en- 
tries in {u, u + A*^, A''^} are guaranteed to be nonnegative by 
the Perron-Frobenius theorem for nonnegative matrices |18|. 
Although in this paper we only consider matrices with positive 
entries so that the Perron-Frobenius theorem can be applied, 
in general our analysis only requires that the eigenvalue with 
largest magnitude A is real and well separated from the re- 
maining eigenvalues. While this is typical for networks with 
positive links |10|, it is also observed for networks with neg- 
ative links provided that they represent a small fraction of the 
number of links (e.g., see Fig. 6 in 12|). 



A. Effect of module addition 

We restrict our analysis to cases where the effect of the 
module addition is small, which will allow us to study its 
effect as a perturbation to the original eigenvalue problem. 
This restriction is applicable to describing heavy-sided merg- 
ers and applications for which a network is modified gradu- 
ally, such as the expansion of infrastructure. Considering the 
upper and lower blocks of Eq. ([T]l independently and after left- 
multiplying the top block by the left principal eigenvector 
(i.e., A = Xv^), we obtain 



SX = 



■j^XA^ 



A^ = [{X + SX)I^-S]-'y^{u + A^), 



where is the identity matrix of size m. 

Assuming that the effect of the module addition is small, 
we have SX <C A, A^ <^ v^u, and (5A <C |A — Asj, where 
Xs is the largest eigenvalue of the module. To first order, we 
find 
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where we have defined = {I„i — S/X)^^. These expres- 
sions relate the change in the dominant eigenvalue SX to the 
topology of the added module S, the spectral properties of 
the original networks (u, v, and A), and the way in which 
the module is coupled to the network by matrices X and Y. 
When the module contains few nodes, approximating SX by 
inverting an m x m matrix is significantly more efficient and, 
as we will see, offers more insight than solving the origi- 
nal (m + n) X (m + n) eigenvalue problem. Using v — u 
and X = Y for undirected networks, Eq. (|2]i simplifies to 
SX^ X-\XTu)^KS{X^u). 

If the connections between the module and original network 
are made randomly, we can use Eq. (j2]l to estimate average 
values of SX. Suppose that the entries of the matrix X are 
independent random variables such that Xij = 1 with prob- 
ability x/{nm) and otherwise, so that the expected number 
of links from the original network to the added module is x. 
Similarly, we assume that the entries of Y are independent 
random variables which are 1 with probability y/ [nm) and 
otherwise. By averaging Eq. (j2]) and using the independence 
of X and Y , we find 
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where u — n ^ v — n ^ 5I]j=i '^j- Thus, in ad- 

dition to properties dependent on the original network, {SX) 
is proportional to the product of the relative number of con- 
nections to and from the module (xy/m?) and on the sum of 
elements in the matrix . Moreover, for large A/Ag we have 
Kfj ~ tn, the number of nodes in S. While this expres- 
sion provides us with the average ((5 A) when X and Y are 
chosen randomly, as discussed in Sect. |in] strategically se- 
lecting connection matrices {X,Y) (e-g-, to maximize SX) can 
lead to significant variations in SX for a given module. 

For the optimization objectives explored later in this text, as 
well as situations in which computing is inconvenient, it 
is useful to represent Eqs. (j2]i and (j3]l using a series expansion 
for A"^. For Ag < A, we have A'^ = (/,„ - S/X)-^ w 
Y^^j^^i.^ I ■ We thus define the fc-th order approximations 



SXk = y A-^f ^X^^F^M, (5) 

Xv^ u ^-^ 



k— 1 

Af - ^A-(^+i^5^F^ 



(6) 
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Network and reference 


N 


id) 


A 


A2 


Neural network of C. elegans 1 19| 


297 


7.9 


9.2 


5.7 


Network of political blogs |20| 


1490 


12.8 


34.4 


26.8 


Yeast PPI network 02111 


2361 


5.6 


12.1 


9.4 


Word association network 1221 


5018 


12.7 


13.4 


10.2 



TABLE I: Test networks used and their characteristics: number of 
nodes A'^; mean degree (d); largest eigenvalue A; and second largest 
eigenvalue A2. 



Because the matrices iX,Y) are often sparse and the module 
is often much smaller than the network, Eq. (jSj) is typically 
very computationally efficient. We note that for large enough 
k, the eiTor introduced by Eq. Q dominates the eiTor of series 
truncation in Eqs. (|5]l and (j6]|. No gain was found by using 
/c > 4 in the experiments that are to follow. 
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B. Numerical tests on real networks 

We test our approximations by considering module addi- 
tions to four networks: a neural network of C. elegans fWl; a 
network of political blogs EOl : a network of protein-protein 
interactions in the organism S. cerevisiae (i.e., brewers/bakers 
yeast) fT\\ \ and a network of associations between words f22|. 
Their characteristics are summarized in Table [l] We begin by 
examining the average effects for adding a module using ran- 
dom connections. First, matrices were constructed by ran- 
domly selecting 10 entries in X and F to be 1 and the rest 
to be (i.e., in the previous notation, x — y — 10). For 
each realization 6X^^^, the actual eigenvalue shift [i.e. solv- 
ing Eq. ([TJ], was compared to our approximations given by 
Eqs. (j2]i and (j5]l. In the top panel of Fig. |2j Eq. Q (stars) is 
shown to accurately predict the numerically-observed average 
(SX) (solid Une) for connecting the modules to the directed 
neural network of C. elegans using 10^ realizations of (X,Y)- 
Average values for the relative error e = (SX — dX'^^^) /SX'^^^ 
are plotted in the bottom panel for both the neural network 
(circles) and an network of political blogs (triangles) (see Ta- 
bl^ for all 13 non-isomorphic, directed modules of size 3. 
(Results for the other networks were found to be similar and 
are omitted for clarity.) Solid lines correspond to Eq. (j2|i, 
while dotted (dashed) lines correspond to Eq. (j5]l with k — 1 
(k = 2). 

It can be observed in Fig.|2]that (SX) changes substantially 
for the different three-node modules (for all networks, {6X) 
typically increased ^ 20% from module 1 to module 13). Ob- 
serve that the average error (e) of Eq. (jsjl when the module 
structure is not used [A: = 1 (dotted lines in lower plot)] is 
strongly correlated with (dX) (upper plot). This is to be ex- 
pected as the error from neglecting module structure should 
be related to that structure's ability to modify A. Note that for 
the political blog network (triangles), using A; = 2 in Eq. (|5]l 
is nearly as accurate as directly using Eq. Q. As previously 
mentioned, for large enough k the dominant source of error 
comes from neglecting higher orders of SX/X in the deriva- 



FIG. 2: (Color online) 5X and approximation errors, e, were aver- 
aged over 10* realizations of connecting a three-node module to the 
networks in Table |l] using 10 random links (see text). Equation Q 
(stars) is shown to be accurate in the upper panel for typical results 
for the neural network of C. elegans. The average relative error (e) 
for the neural network of C. elegans (circles) and a network of polit- 
ical blogs (triangles) are given in the lower plot, where Eq. ^ (sold 
lines) and Eq. ^ with k = 1 (dotted) and k = 2 (dashed) are shown. 

tion of Eq. (j2]l [as opposed to series truncation in Eq. (|5]l]. 

The validity of our approximations for specific connections 
is shown by considering the addition of two bidirectionally- 
linked nodes (m = 2) to an undirected protein-protein in- 
teraction (PPI) network and a directed network of word as- 
sociations (see Table [ijl. In order to illustrate the dependence 
of (5 A on the matrices X and Y, we will consider two con- 
nection strategies: connecting the module to nodes with ei- 
ther (A) increasing nodal degrees or (B) increasing eigenvec- 
tor entries. For strategy A, the nodes in the original network 
are ordered so that the in-degrees monotonically increase: 
dl" < 4" <•••<<'. Then for k e {1, 2, ...,N - 20}, 
we establish a directed link from nodes {k,k + l, . . . ,k + 20} 
to both nodes in the module. The nodal out-degrees are then 
ordered such that c?°"* < d™* < • • • < df* and links are 
made to nodes {ik, ik+i, ■ ■ ■ , ik+20} from both nodes in the 
module. The case fc = corresponds to connecting the net- 
work nodes with smallest to both module nodes, which in 
turn connect to the nodes with smallest c?""*; whereas the case 
fc = — 20 corresponds to connecting the nodes with largest 
to both module nodes, both of which in turn connect to 
the nodes with largest d°"* (shown schematically in Fig. [3^). 

For strategy B, we now order the nodes in the original 
network in order of increasing entries of the left eigenvec- 
tor V so that wi < < • • • < Wat. As before, for fc e 
{1, 2, N - 20}, we connect nodes {fc, fc + 1, . . . , fc + 20} 
in the network to both module nodes, both of which in turn 
connect to nodes {ik, ik+i, ■ ■ ■ , ik+20}, where the indices ij 
now correspond to the ordering of the right eigenvector en- 
tries such that Mil < < • • • < '"iw For ^oth strategies. 
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III. OPTIMIZING CONNECTIONS 

The issue of efficiently decreasing A by removing nodes or 
links from a network has been recently addressed |i8i|, where 
it was found that when removing a single node, A is most de- 
creased by removing the node with largest dynamical impor- 
tance. We consider a closely related issue: given a module S 
to be added to a network A with given constraints (such as a 
fixed number of connections), how should the links between 
the network and module be chosen to either maximize or min- 
imize 8X1 Given some set of constraints and staying within 
our previous assumptions, we will look for matrices 
that maximize (or minimize) (5A in Eq. Q. In the examples 
that follow, it is helpful to assume that the node indices are 
now ordered such that the left eigenvector entries are in de- 
creasing order: f i > f 2 > • • • > '^'n > 0. In addition, the 
entries of the right eigenvector are ordered using indices {Zi} 
so that ui-^ > > ■ ■ ■ > ui^ > 0. (If A is symmetric, u = v 
and li = i.) We will present our optimization methodology 
for two examples, yet the techniques presented are general and 
have potential application beyond these particular constraints. 



A. Example I: multiple links per module node 



FIG. 3: (Color online) Eigenvalue shift 5\ for connecting a two-node 
module to (a) the word association network and (b) the PPI network. 
Equation |2| (crosses) agrees well with actual values 5}?^^ (solid 
line) for strategy B. The x's and circles show the same respective 
quantities for strategy A. As indicated by the drawing, increasing 
k corresponds to connecting the module to nodes with increasing 
degrees (strategy A) or eigenvector entries (strategy B). 



the indices simplify for undirected networks, for which we 
have u = V, d""* = d*", and ii. = k. 



In Fig. [3] <5A is plotted for strategies A and B as a function 
of the parameter k for both (a) the directed word-association 
network and (b) the undirected PPI network. For strategy 
B, the crosses show the approximation given by Eq. Q and 
the solid line shows the numerically-calculated value from di- 
rectly solving the eigenvalue problem Eq. ([T]i. The x's and 
circles respectively show the same quantities for strategy A. 
The first observation is that the approximation for SX works 
well, with only a small deviation as the perturbation becomes 
large (not shown). One can observe that strategy B is supe- 
rior for yielding either large or small SX for both networks. 
However, the two strategies are similar for producing large 6X 
for the PPI network in Fig. This is expected when the 
first-order approximations to the eigenvectors {ui cx d""* and 
Vi oc d™ El) are valid. The results of this experiment sug- 
gest that it may be useful to devise connection strategies to 
systematically maximize (or minimize) 6X. 



In the first example we assume that the number of connec- 
tions from the original network to the module, x, and the num- 
ber of connections from the module to the original network, y, 
are fixed and less than n, the number of nodes in the original 
network. It is also assumed that all links have strength one 
(i.e., Xij, Yij £ {0, 1}) and multiple links per module node 
are allowed. 

The right hand side of Eq. (j2]i, which approxi- 
mates the quantity to be maximized, is propoitional to 
J2i ji^'^'^')! K^j{Y'^u)j. This sum can be maximized by (i) 
finding indices a and b such that Kab — J^BXij{Kij} and 
(ii) choosing X and Y to make (X'^v)'^ and {Y'^u)i, as large 
as possible. The scalar (X^v)'^ is maximized by placing the 
X ones in the a-th column of X and in positions 1, 2, . . . , a; 
coiTesponding to the largest values of v, while {Y'^u)'[ is 
maximized by placing the y ones in the 6-column of Y and 
in positions li,l2, ■ ■ ■ ,ly corresponding to the largest values 
of u. In this way, {X'^v)f = Sia X]J=i ^^'^ = 
Sibjyj^i "^ij' where Sij is Kronecker's delta. The maximum 



of Eq. (|2]l is then 



6X'' 



iff 



Xv'^1 



Mi, 



(7) 



This result implies SX may be maximized for the constraints 
of example (I) by connecting the x nodes with the largest left 
eigenvector entries vi in the original network to a single node 
in the module (having index a), and by also originating all 
links from the module to the original network from a single 
module node (having index b) to the y nodes in the original 
network with the largest entries of the right eigenvector u. 
For large values of A/A^, the maximum entry of matrix K'^ 
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is typically in its diagonal, yielding a = 6 as shown in Fig|4] follows that Eq. Q yields 



FIG. 4: (Color online) A typical optimal connection for example (I): 
node i (a point of contraction with large left eigenvector entry Vi) 
points to a node in the module, which in turn points to node j (a 
point of expansion with large right eigenvector entry Uj ). 

For a heuristic interpretation of this result, let us assume 
that e {0, 1} and denote L°'P = J2j{Ap),j and i,*'^ = 
'^he number of paths of length p originating 
from and terminating at node i, respectively. Thus Lp — 
is '^o'^^l number of paths of length p. These 
quantities satisfy ||i°'^||2'"'"^r^ ~^ Il-^i'^ll2'^^i''' 



Vi, 



and Lp+i/Lp X sls p ^ oo 1231 . Therefore connecting 
nodes with large Vi (which receive many paths) to nodes with 
large Ui (which distribute many paths) will have the largest 
impact in how Lp grows with p, which determines A. We 
therefore define a node i with large Vi as a point of contraction 
and a node j with large uj as a point of expansion. Therefore 
our result for example (I) is that the effect of the whole mod- 
ule is to act as a bridge from points of contraction to points of 
expansion in the original network. 



B. Example II: one link per node 

In the second example we require that, in addition to a fixed 
number of links x and y with unity strength, no more than 
one link can be added to a particular node in the module or 
original network. Because undirected links are equivalent to 
two links and violate our constraint, it is reasonable (although 
not necessary) to assume that the network and module are di- 
rected. To treat this case, we maximize successive terms in 
Eq. (jsj. The first term, v'^XY'^u/X, vanishes since any entry 
of XY^ is nonzero only if there is a module node that has 
links both to and from the network, a situation which is not 
allowed by our constraint. Therefore, we maximize the next 
term, {X'^ v)'^ S (Y'^ u) / X^ . As shown in Fig. [sji, let us denote 
the set of nodes in the original network that point to the mod- 
ule as NO (network outgoing), the set of nodes in the module 
that are pointed to by the original network as SI (module in- 
coming), the set of nodes in the module that point to the orig- 
inal network as SO (module outgoing), and the set of nodes 
in the original network that are pointed to by the module as 
NI (network incoming). Because no node can have more than 
one new link, there is a one-to-one correspondence between 
nodes in NO and nodes in SI. The index of nodes in SI will 
be represented as ij, where node j in NO points to node ij 
in SI. We have {X^v)f. = Vj if j G NO and ij e SI, and 
otherwise. With a similar notation for SO and NI, we have 
{Y'^u)mk = Uk if rrik € SO and k E NI, and otherwise. It 
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This expression is maximized if S contains a directed com- 
plete bipartite graph for disjoint subsets SI and SO such that 
every node in SI points to every node in SO (see Fig. [5^). As- 
suming that one can be found, we may set Si^mk = 1 and look 
for sets NO and NI that solve 
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(8) 



Let Q = {i}f=i n {/Jj'^i. If Q = then Eq. ^ is solved by 
letting NO = {i}f=i and NI = {hV^^i, which yields 



<5A" 



X^v^u 



(9) 



As indicated in Fig. |5^, this corresponds to selecting nodes of 
contraction for NO and nodes of expansion for NI. 

The significance of link choices for maximizing 5X is 
shown in Fig.jS]?, where the module in Fig. was added to the 
neural network of C. elegans with constant node selections for 
NI and NO but using several module orientations (defined as a 
particular choice for the disjoint sets SO and SI in the module, 
and shown in the horizontal axis of Fig. |5j)). The solid lines 
show 5X/X found numerically using NI — {li, I2] and either 
NO = {1, 2} (thick) or NO = {2, 1} (thin) (see next paragraph 
for discussion). Symbols indicate 5X/X found using Eq. ^. 
One can observe that our maximization strategy for example 
(II) (Fig.|5^) does in fact maximize 5X (see orientation 6). An 
important practical issue is that the eigenvectors may be un- 
known and require estimation using local information. One 
can observe that attempting to maximize using the first- 
order approximations Vi oc and ut oc d""* |8| may also 
be a good strategy (dashed lines). If necessary, a more refined 
approximation for the eigenvectors may be sought (e.g., using 
second-order neighbors |9 |). 

It is important to note that we have so far neglected higher 
order terms of Eq. (jSj) in addressing example (II), which are 
responsible for the difference in &X for the permutation NO = 
{1,2} or NO = {2,1|. Attempting to maximize the third term 
of the series in Eq. ([Sjl (which is proportional to v^XS^Y^u) 
while using the nodes of contraction, 1 and 2 (with vi « 0.58 
and V2 ~ 0.23), we see that the more-dominant point of con- 
traction (node 1 ) should link to the module node indicated by 
the dashed arrow in Fig. |5^. (Note that there is a path of length 
2 stemming from this node to each node in SO, whereas there 
are none for the other node in SI.) Unlike permuting nodes in 
SI, permuting nodes in SO had little effect for this network 
since ui-^ « ui^ ~ 0.23. 

Up to this point we have assumed Q — %, where Q is de- 
fined just after Eq. ([8]l; however this may not always be the 
case. For example, as more links are made (i.e., for increas- 
ing X, y), one would expect some nodes to have large values 
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for both Vi and Ui. This may also occur for networks with 
correlations between d'" and 6?°"* and, in fact, always occurs 
for undirected networks where li ^ i V i. For these situa- 
tions, nodes in Q must be allocated to either NO or NX and 
additional nodes must be selected. Considering the limiting 
case of an undirected network under the constraints of exam- 
ple (II), maximization of the second-order term in Eq. Q in- 
dicates that we should choose NO,NI C (Recall that 
the first-order term is zero by our constraints.) The alloca- 
tion of these indices should then correspond to successively 
maximizing the third-, fourth-, fcth-order terms until all de- 
grees of freedom have been exhausted. While this strategy of 
successive maximization does not guarantee the optimal con- 
nections (which would require considering all possible links 
between S and A), it is computationally efficient and ensures 
a near-optimal solution. 




FIG. 5: (Color online) (a) Typical optimal link selections for exam- 
ple (II) for X — y = 2. Two points of contraction (NO) link to two 
module nodes (SI) and the remaining two module nodes (SO) link to 
two points of expansion (NI). The module also contains a directed 
complete bipartite graph pointing from SI to SO. (b) Under the re- 
strictions of example (II), the module in Fig. |5ji was connected to 
the neural network for C. elegans using various orientations. Solid 
lines indicate letting NI — {hyh} and either NO — {1,2} (thick) or 
NO = {2, 1} (thin). Symbols show Eq. |2|. Approximating points 
of contraction (expansion) by nodes with large d'" (ci°"*) also offers 
a decent strategy (dashed). 



IV. DISCUSSION 

While we have presented an efficient strategy for maximiz- 
ing 6X for the addition of a module under two examples of 
constraints, our methodology is general and is thus applica- 
ble for many constraints not discussed here. For example, the 
problem of minimizing 5X under the constraints of example 
(II) may be solved by minimizing successive terms of Eq. (j5]l. 
Heuiistically, this coiTesponds to connecting nodes in A with 
small values of Vn to the module, and then from the module to 
nodes in A with small values of u„. The module should also 
be oriented so as few links as possible point from SI to SO. We 
now discuss several applications of using module addition(s) 
to direct dynamics on networks. 

Increasing A has many real-world applications. For exam- 
ple, because A relates to the ability of network-coupled os- 
cillatory systems to synchronize 1 1 , 2 1, one or several module 
additions to increase A may be useful to promote synchroniza- 
tion in, for example, a biological process or power grid. More- 
over, epidemic thresholds of spreading processes on networks 
are often dependent on A~^ Q. Increasing A can increase 
the connectivity of a network, improving flow and reducing 
the epidemic threshold. This may be useful, for example, if 
one wants to improve communication over a social network 
or routing-system. The related problem of percolation on net- 
works (where nodes and/or links are randomly removed) is 
also related to A~^ f4|. Increasing A can increase a network's 
robustness against network degradation under failure, black- 
out, jamming, or attack. 

For other dynamical systems, it is beneficial to have a small 
value for A. For example, the instability of equilibria for 
a system of network-coupled ordinary differential equations 
(ODEs) (e.g., interactions in a metabolic network) is related 
to the largest eigenvalue of a weighted adjacency matrix de- 
fined in terms of the system's Jacobian |5| (i.e., if A < 1, then 
the equilibria are stable). When the eigenvalue of the Jaco- 
bian matrix with largest magnitude is real and well separated 
from the bulk of the spectrum, our method is applicable. For 
example, besides choosing appropriate link weights to keep 
6X small, choosing optimal connections and module orien- 
tation (as shown in Sect. |lll]i may also aid in preserving the 
stability of equilibria for a system undergoing modification. 
Such analysis may be relevant, for example, in understand- 
ing the formation of ecological communities for which the 
largest eigenvalue of the system's Jacobian has already been 
suggested to guide the network's evolution under species ad- 
ditions and subtractions [ 15 | . 

Future applications of our results are also not Umited to net- 
work dynamics for which the dependency on A is currently 
well-established. For example, minimizing d\ for a mod- 
ule addition may present an effective strategy for minimizing 
global effects during a network modification. Possible appli- 
cations may include aiding the in development of systems- 
level drug design by indicating candidate drug targets that are 
less invasive (e.g., nodes with middle-valued degrees are typ- 
ical US)). The importance of developing mathematical ap- 
proaches for this promising field are often mentioned |13|. 
Another open question is the implications of our results on 
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the prevalence of subgraph motifs, which have been proposed 
to be the basic building blocks of biological networks 1 16 J . In 
contrast to several studies showing that global dynamics of a 
system can depend on the structure of subgraph motifs ifTTl . 



our results suggest that "how" motifs are connected in the net- 
work may be as important as their structure. 

The work of D. T. and J. G. R. was supported by NSF Grant 
No. DMS-0908221. 



[1] J. G. Restrepo, E. Ott, and B. R. Hunt, Phys. Rev. E 71, 036151 

(2005) ; Physica D 224, 1 14 (2006); Phys. Rev. Lett. 96, 254103 

(2006) . 

[2] J. G. Restrepo, E. Ott, and B. R. Hunt, Chaos 16, 015107 
(2005). 

[3] Y. Wang et. al, in 22nd Symposium on Reliable Distributed 
Systems (SRDS 2003), 68 October 2003, Florence, Italy (IEEE 
Computer Society, New York, 2003), p. 25; D. Chakrabarti et. 
al, ACM Trans, on Infor. and Syst. Sec. 4, 13 (2008); P Van 
Mieghem, J. S. Omic, and R. E. Kooij, IEEE ACM Trans, on 
Net. 17, 1 (2009). 

[4] I. G. Restrepo, E. Ott, and B. R. Hunt, Phys. Rev. Lett. 100, 
058701 (2008); B. Bollobas et. al. The Annals of Prob. 38, 150 
(2010); D. Taylor and J. G. Restrepo, in preparation. 

[5] R. May, Nature London 238, 413 (1972); S. Sinha, Physica 
A 346, 147 (2005); J. Feng, V. K. Jirsa, and M. Ding , Chaos 

16, 015109 (2006); M. Brede and S. Sinha, e-print aiXiv:cond-| 

m at/0507710 Our method is applicable to systems where the 
eigenvalue of the lacobian matrix with largest magnitude is real 
and well separated from the bulk of the spectrum. 

[6] A. Pomerance et. al., PNAS 106, 8209 (2009). 

[7] D. B. Larremore, W. L. Shew, I. G. Restrepo, Phys. Rev. Lett. 
106, 058101 (2011). 

[8] I. G. Restrepo, E. Ott, and B. R. Hunt, Phys. Rev. Lett. 97, 
094102 (2006). 

[9] A. Milanese, J. Sun, and T. Nishikawa, Phys. Rev. E 81, 0461 12 
(2010). 

[10] S. Chauhan, M. Girvan, and E. Ott, Phys. Rev. E 80, 056114 
(2009). 



[11] A. K. Naimzada, S. Stefani, and A. Torriero, Networks, Topol- 
ogy and Dynamics: Theory and Applications to Economics and 
Social Systems, (Springer- Verlag 2009). 

[12] T. Hase et. al, PloS Comp. Biol. 5(10), el000550 (2009). 

[13] H. Kitano, Nature Rev. Drug Disc. 6, 202 (2007); G. R. Zim- 
mermann, I. Lehar, and C. T. Keith, Drug Disc. Today 12, 34 

(2007) ; H. Ma and I. Goryanin, Drug Disc. Today 13, 402 

(2008) . 

[14] S. Sinha and S. Sinha, Phys. Rev. E 74, 0661 17 (2006). 

[15] I. A. Drake, J. Theor. Biol. 147, 213 (1990); C. C. Wilmers, S. 
Sinha, and M. Brede, Oikos 99, 363 (2002). 

[16] R. Milo et. al. Science 303, 1538 (2004); U. Alon, Nature Rev. 
Gene. 8, 450 (2007). 

[17] V. P Zhigulin, PRL 92, 238701 (2004); R. I. Prill et. al, PLoS 
Biol. 11, e343 (2005); P Kaluza et. al, Phys. Rev. E75, 015101 
(2007); Chaos 18, 026113 (2008); 

[18] R. B. Bapat and T. E. S. Ranghavan, Nonnegative Matrices 
and Applications, (Cambridge University, Cambridge, England, 
1997); P. Van Mieghem, Graph Spectra for Complex Networks, 
(Cambridge University, Cambridge, England, 201 1). 

[19] I. G. White et. al, Phil. Trans. R. Soc. London 314, 1 (1986). 

[20] L. A. Adamic and N. Glance, in WWW-2005 Workshop on the 
Weblogging Ecosystem, May 10, 2005, Chiba, Japan. 

[21] D. Bu et. al. Nucleic Acids Research, 31, 2443 (2003). 

[22] D. L. Nelson, C. L. McEnvoy, and T. A. Schreiber (unpub- 
lished), obtained from |http://www.usf.edu/FreeAssociation/|. 

[23] G. H. Golub and C. F. Van Loan, Matrix Computations, 3rd Ed., 
(Johns Hopkins University, Baltimore, 1999). 



